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Abstract: We give analytic methods for nonparametric bias reduction that remove the need for 
computationally intensive methods like the bootstrap and the jackknife. 

We call an estimate pth order if its bias has magnitude Uq^ as tiq — > cxd, where no is the sample 
size (or the minimum sample size if the estimate is a function of more than one sample). Most 
estimates are only first order and require 0{N) calculations, where N is the total sample size. The 
usual bootstrap and jackknife estimates are second order but they are computationally intensive, 
requiring 0{N'^) calculations for one sample. By contrast Jaeckel's infinitesimal jackknife is an 
analytic second order one sample estimate requiring only 0{N) calculations. When pth order 
bootstrap and jackknife estimates are available, they require 0{NP) calculations, and so become 
even more computationally intensive if one chooses p > 2. 

For general p we provide analytic pth order nonparametric estimates that require only 0{N) 
calculations. Our estimates are given in terms of the von Mises derivatives of the functional being 
estimated, evaluated at the empirical distribution. 

For products of moments an unbiased estimate exists: our form for this "polykay" is much 
simpler than the usual form in terms of power sums. 

1 Introduction and Summary 



Let T{F) be any smooth functional of one or more unknown distributions F based on random 
samples from them. Bias reduction of estimates of T{F), say T(F), has been a subject of con- 
siderable interest. Traditionally bias reduction has been based on well known resampling methods 
like bootstrapping and jackknifing in nonparametric settings, see Efron (1982). However, these 
methods may not be effective in complex situations when the sampling distribution of the statistic 
changes too abruptly with the parameter, or when this distribution is very skewed and has heavy 
tails. Also the robustness properties of F may not be preserved for T(F) for all T(-). 

Recently, various analytical methods have been developed for bias reduction in parametric 
settings. Withers (1987) developed methods for bias reduction based on Taylor series expansions. 
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Sen (1988) established asymptotic normality of ^/n{T{F) — T{F)} as n —>■ oo under suitable 
regularity conditions. Cabrera and Fernholz (1999, 2004) defined a target estimator, for a given T 
and a parametric family of distributions it is defined by setting the expected value of the statistic 
equal to the observed value. Cabrera and Fernholz (1999, 2004) established under suitable regularity 
conditions that the target estimator has smaller bias and mean squared error than the original 
estimator. See also Fernholz (2001). 

This paper provides the first analytical methods for nonparametric bias reduction. We give 
three analytic methods for obtaining unbiased estimates (UEs) of any smooth functional T(F). 
These UEs are in general infinite series which in practice need to be truncated. Let us define 
a pth order estimate as one with bias O(nQ^) as no oo, where no is the minimum sample 
size. Our truncated pth order estimates require only 0{N) computations, where N is the total 
sample size. By contrast computer intensive methods, like the pth order bootstrap and jackknife 
estimates require 0((ni • • • nfc)^) calculations. Put another way, for fixed p, the computational 
efficiency of our analytic pth order estimate relative to the pth order bootstrap or jackknife estimate 
is 0(n^-'). So, our truncated estimates remove the need for these computationally intensive 
methods of nonparametric bias reduction. The downside is that the details must be worked out 
for each nonparametric functional of interest. This involves calculating the von Mises or functional 
derivatives of the functional up to order 2p— 2. When von Mises (1947) introduced these derivatives, 
he did not define them uniquely, nor did he give a method to obtain higher derivatives. This was 
rectified in Withers (1983): the second derivative is not the derivative of the first derivative, but 
requires a 'correction' term, von Mises did give a method for calculating the first derivative, also 
known as the influence function and this is well known and widely used, von Mises' expansion for 
say T{F) about T{F) was extended to functionals of more than one distribution in Withers (1988). 
This introduced for the first time the partial von Mises derivatives and showed how to calculate 
them. 

Suppose we observe k independent random samples of sizes n = (ni, . . . ,nk) from k unknown 
distributions F = (Fi, . . . , F^) on R^^, . . . , i?^*, where R is the real hue. Let F = (Fi, . . . , F^) be 
their k empirical (or sample) distributions. We shall give three pth order estimates of any smooth 
functional T{F) in terms of the derivatives of T{F) up to order 2p — 2 evaluated at F. 

As noted we derive these pth order estimates from three forms of UE for T{F). These are 
all infinite series unless T{F) is a polynomial in F, (for example, a polynomial in the moments 
of Fi, . . . , Ffc). Truncation of these series yields three forms of estimates of T{F) of bias O(nQ^), 
where no = min^!^^ n, and p > 1 is any specified integer. 

We call these three forms of estimates the S,T and V estimates. For p = 2, all three forms of 
estimates have k + 1 terms. But for p > 2 the S estimate is the best choice, requiring fewer terms 
than the T estimate or the V estimate: see Section 5. The T estimate is its power series equivalent. 
The V estimate is an intermediate form for arriving at the S estimate. 

If r(F) is a product of moments or cumulants, then an unbiased estimate of it exists, and is 
given by our S estimate with the appropriate choice of p. Special cases include the UEs of the 
cumulants of Fisher (1929), the UEs of the central moments of James (1958), and the polykays 
of Wishart (1952) given in terms of the power sums via tables of the symmetric polynomials: see 
Stuart and Ord (1987, Section 12.22). Our S estimate gives these polykays in terms of the sample 
central moments and so is much more compact and avoids the need for these tables. 

For p = 2 and k = 1 the relation of our S estimate to the infinitesimal jackknife of Jaeckel 
(1972) is given in Appendix A. Jaeckel gave formulas for second order estimates in terms of the 



2 



derivatives with respect to the weights of T{F), where F is now the weighted empirical distribution. 
His formulas are equivalent to our second order one sample S and T estimates. Our formulas are 
given in terms of the second derivatives of T{F). 

For the case of one sample problems (functionals of only one distribution function), the S and T 
estimates given here were obtained by a much more laborious approach in Withers (1994a) starting 
with an expansion for ET{F) based on a generalised delta method; results were given up to p = 4. 
(This also contains more examples.) Here these results are extended to p = 6 for the general A;- 
sample problem. The present method uses [/-statistics and so bypasses the need in Withers (1994a) 
to differentiate functionals of derivatives. 

At this point we give four simple one sample examples dealt with in Section 6: 

• For univariate data, a second order estimate of the standard deviation T{F) = cr is T{F){1 + 
m~^si{F)}, where m = n or n — 1, si{F) = {P4 + 3)/8 and P4 is the kurtosis, that is the 
standardised fourth central moment. 

• For univariate data, a second order estimate of T(F) = fi/a is T{F) + n~^Si{F), where 
Si{F) = -P3/2 - T{F){3P4 + l)/8 and /?3 is the skewness, that is the standardised third 
central moment. 

• For bivariate data a second order estimate of the ratio of marginal means T{F) = /X1//X2, is 

(Xl/X^){l + n-^[X^/(Xl X2) - Xl/X^\ 

(The usual ratio estimate T[F) = X1/X2 has bias 0(n~^).) 

• For multivariate data, we give a second order estimate of T{F) = (a'/x)^, where fi is the mean 
vector and a is any given vector of the same dimension, is 

{a'm^ - Q ia'nr'a'Va/{n - 1)}, 

where ju is the sample mean, and V is the sample covariance. 

Applications to skewness and kurtosis have already been given in Withers (1994b). A /c-sample 
univariate example is given by interpreting Hi in the last example as the mean of the ith distribution 
sampled, /2j as the mean of the ith. sample, and replacing a'Va/{n — 1) by X]i=i '^i ~ 1)' 

where Vi is the ith sample variance. All these examples allow for a possible initial transformation 

of the data X h{X) say. 

The three analytic methods for obtaining UEs are as follows. The simplest UE for T{F) has 
the S estimate 

00 

E Si,...i,{F)/{ini-l)i,---ink-l)i,}, (1.1) 

n,...,ife=o 

where {m)i = m{m — 1) • • • (m — z + 1) = m\/{m — Clearly this can be transformed if desired 
to the T estimate 

00 

E T,,...,,{F)nr'...n-'K (1.2) 
n,...,ifc=o 
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The coefficients ^^^...^^.(F) and Ti^...i^{F) are functions of the partial von Mises derivatives of T[F) 
of order up to (2ii, . . . , 2ifc). The third form of UE for T{F) has the V estimate 

oo 

%...rJ{rl\■■■rf^), (1.3) 

ri,...,rfc=0 

where Vr^.-.r^. is determined by the partial derivatives of T{F) of order (ri, . . . ,rfc). If T{F) is a 
polynomial in F (such as a polynomial in the moments and cumulants of -F), then the S and V 
forms of the UE reduce to finite sums. 

In Section 2 we derive the V estimate (|1.3p and its multivariate analogue using [/-statistics and 
tables of the symmetric polynomials. Section 3 derives from it the S estimate (jl.ip . Section 4 
derives the T estimate <\1.2\ . The number of terms required for these estimates and the bootstrap 
estimate are compared in Section 5. Finally, Section 6 illustrates the three estimates using various 
examples, including the four listed above. We show in particular that our estimates consistently 
outperform those due to Sen (1988) and Cabrera and Fernholz (1999, 2004). Computer programs in 
MAPLE for the implementation of the V ^ S and T estimates for any p and k are given in Appendix 
B. 

We shall often use bold to denote an integer vector, for example, n for (ni,n2, . . . ,nfc), and 1 
for (1, . . . , 1). Similarly, we write r! = ri! • • • r^! and (m)i = {mi)i^ ■ ■ ■ {mi^)i^. With this notation, 
([ri])-([L3]) become 

oo oo oo 

Y,Si{F)/{n-l),, Y.^,{F)/n-\ J^K/r!. 

i=0 1=0 r=0 

We show that the truncated forms 

p-1 p-1 2p~2 

SnpiF) = Si{F)/{n - TnpiF) = ^ Ti{F)/n~\ Vnp{F) = ^ K/r!, 

i=Q 1=0 r=0 

all have bias 0(n^^^ + • • • + n^^'') as n — > oo. 



2 The V Form of Unbiased Estimate 
2.1 One Sample 

Let us first consider the case of one distribution F on R'^ and one sample Xi , . . . , X„ . For G any 
distribution on the von Mises- Taylor expansion of T{F) about T(G) is 

oo 

T{F) = Y,yr{F,G)/r\, (2.1) 

r=0 

where Vo{F,G) = T{G) and Vr{F,G) = f ■ ■ ■ f Tg{xi ■ ■ ■ Xr)dF{xi) ■ ■ ■ dF(xr) for r > 1, and 
Tg{xi ■ ■ ■ Xr) is the rth order (von Mises) derivative of T{G), uniquely defined by (j2.ip subject to the 
constraints that Tg{xi ■ ■ ■ Xj-) is not altered by permuting xi, . . . , Xr, and / Tg{xi ■ ■ ■ Xr)dG{xi) = 0. 

The first derivative or influence function of T (G) isjustrG(2;) = lim^^Q{T{Ge) — T{G))/€, where 
Ge{y) = {l — e)G{y) + eI[y < x) and I{A) is 1 or for A true or false. A simple method of obtaining 
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Tg{xi ■ ■ ■ Xr) from Tg{xi ■ • -Xr-i) was given in Withers (1983). For example, S{G) = Tg{x) has 
derivative Sciy) = Tg{x, y) — Tciy) so this gives the second derivative of T{G) in terms of its first 
derivative. Similarly, S{G) = TG{x,y) has derivative Sciz) = TG{x,y,z) — Tc^z^y) — Tg{x,z) so 
this gives the third derivative. The analogous formula holds for the derivative of the general rth 
order derivative, with r 'correction' terms subtracted. 

For fixed G an UE of Vr{F, G) is the [/-statistic 

V;"(F, G) = J2 Tg{X,, ■ ■ ■ X,J/(n)„ (2.2) 

r 

where sums over all (n)^ permutations of distinct ii, . . . ,ir in 1, . . . , n. So, 

n „ 

nV^{F,G) = Y,TG{Xi)=n TG{x)dF{x), 

i=l 

n n n 

{nhV^{F,G) = Y.TG{X,,Xj) = {Y.-Y,)TG{X,,Xj) 

iytj i,j=l i=j=l 

= j j TG{xi,X2)dF{xi)dF{x2)-n j TG{xl)dF{x{), 

where Tg{x\) = Tg{xi^xi), and so on. 

Note that V^{F, G) can be written down using the tables of the symmetric polynomials in Stuart 
and Ord (1987, Appendix Table 10, page 554) for r < 6 and David and Kendall (1949) for r < 12. 
The last column of these tables expresses the symmetric polynomials [1^] = J2r ' " ^ir i where 

sums over distinct ii, . . . , in 1, . . . , n say, in terms of the power sum functions (j) = X^ILi 
for 1 < j < r. For example, [1^] = -6(4) + 8(31) + 3(2^) - 6(21^) + (1^), where for tt = (tti,. . . ,7r,„), 
(vr) = (vTi) • • • (vTm). In general 

r 

[in = E(^)<^)' (2.3) 

TT 

where sums over all partitions vr of r, and the numerical coefficients c(7r) are provided in the 
last column of the tables. The MAPLE procedure symmpoly(...) in Appendix B expresses a given 
number of symmetric polynomials in terms of power sum functions. 

However, the relation (j2.3p remains true if [1''] is redefined as i(xi^ , . . . , Xj^) and (vr) = 
(tti • • • Tim) is redefined as • • • Yllrn=i ^(^h ^ ■ • • ' ^i^T)' '^^i^re x^^ denotes tti arguments equal 

to xi, not a power, and t is an arbitrary symmetric polynomial of r variables. In particular taking 
Xi = Xi and t = Tg, [1^] = {n)rVj^{F,G), and (vr) = Tp^[Tr]n"^^'^\ where m = m(7r) is the number 
of elements in tt, and 

^FG W = /•••/ ^g(^i' • • • • • • dF{xm). (2.4) 

So, (j2.3p can be written 



K"(F,G') = (n)-iEc(vr)rp^H 
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and an UE of T{F) is Ylr^o ^"(-^i G)/r\. Since G is arbitrary we may now take G = F and set 
Vr = V^{F,F), T[7t] = Tpp[7T], T[7r] = Tpp[tt]. For example, for second order estimates we shall 
need f [2] = / Tp{x,x)dF{x). 

Our expression above for LHS (|2.2p at G = F now yields the following V form of UE for T(F): 

oo 

Y^VrM, (2.5) 

r=0 

where 

Vr = (n)-iV~'c(7r)f [7r]n"^W, (2.6) 

and Yln^ is excluding partitions containing 1 because of the constraint / Tp{xi ■ ■ ■ Xr)dF{xi) = 
0. The first few Vr are 

= T(F), Vi = 0, ^2 = -(n - l)-^f [2], 

^3 = 2(n-l)2-if[3], 

Vi = (n- l)3H-6f[4] +3f [22]n}, 

^5 = 2(n - 1)4 i{24f[5] - 20f [32]n}, 

% = (n - l)-i{-120f [6] + 90f [42]n + 40f [S^Jn - lbf[2^]n^}. 

Using the Op{.) notation of Mann and Wald (1943), since V2r-i and V2r are Op{n~^), the UE 
^ is K:2p-2(^) + Op(n-P), where 

i 

r=0 

Note that Vn:2p-2{F) estimates T{F) with bias 0(n"P): K:2(-^) = ^(F) - (n - l)"if [2]/2 has bias 
0(n-2), K:4(F) = K;2(-F) + (n - l)^^f [3]/3 + (n - l)^^(-6f [4] + sf [22]n)/24 has bias 0{n-^), 
and so on. The MAPLE procedures Vestsum(...) and Vest(...) in Appendix B calculate (|2.6p for 
any r and hence Vn:2p-2 for any p, so estimates of bias of any order can be obtained. 

If T{F) is a polynomial in F of degree p, for example, fJ-pi^F), Kp{F) or ^i{FY then rG(xi • • • Xr) = 
for r > p so that V^p(-F) is an UE. 



2.2 More than One Sample 

Now consider the case of /c > 1 distributions, with k samples {^ij, • • • , Xn^j}, ^ < j ^ k. The von 
Mises-Taylor expansion of T{F) about T{G) for G = (Gi, . . . , G^) distributions on , . . . , is 

00 00 00 
=J2 H ^r.-r, {F, G)/(ri! • • • n\) = J2 Vr{F, G)/r\, (2.7) 

ri=0 »'fe=0 r=0 

where 

'11 ■■■ 1 ••■ k k --k 



dFiixi) ■ ■ ■ dFiixr,)- ■ ■ dFiizi) ■ ■ ■ dFkiZr,) 
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and Tg ( ^ ) partial (von Mises) derivative, defined for ai, . . . , a,, in 1, . . . , A; and Xi 

in R^^-i. These were introduced in Withers (1988). They are determined uniquely by (|2.7p and the 
two constraints 

Tg{ ) 

^ \^ Xl ■ • ■ Xr J 

is not altered by permuting columns, and 

jTG{:\ :. Z)dFa^^{x,) = 0. 

In practice they are determined by adapting the rules given above for the one distribution deriva- 
tives, namely: T^^ ^ ^ is just Sc^ix) for S{Ga) = T{G), U{Gh) =Tg(^ " ^ has derivative 

C/g,(?/) =7b( I J ) - Tg( ^ ) 

and similarly for the derivative of the general derivative. 

The term Vq{F,G) is interpreted as T[G). For more details and examples see Withers (1988, 
1994a). For a given G, an UE of Vr.{F, G) is 

v:^{F,G)=Y.Ta[^J::X^^ ::: ^j::X^^)/{n)., 

where "^n-rj, sums over all (ni)^ permutations of distinct in {1, . . . , ni}, . . . and all 

{rikjrk permutations of distinct ji, . . . , jV^ in {1, ... , n^}. So, 

(X) 

Y,Vr-{F,G)/r\ 

r=Q 

is an UE of T{F). Taking G = F, 

oo 
r=0 

is a UE of T{F), where Vr = V;'{F,F). For ii,...,ik in {0,l},V2r-i is Op(n]"''i • • • n^'''=). So, 
Vn:2p-2{F) estimates T{F) with bias 0{n^^^ H h n^^'-') = ©(ng*'"), where 

^ i ^ 

Vn-.jiF) = y^^Vr/rl, no = min nj,po = min pj. 

' l<j<fc l<i<A; 
r=0 

However for pQ > 1, an estimate of T{F) of bias 0{nQ^'^) with fewer terms than Vn;2po-2 is 

2po-2 

VnpoiF)= ^ro/ro!, (2.8) 

ro=0 

where 

riH hrfc=ro 
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If T{F) is a polynomial of degree pi in Fi, . . . ,pk in F^, then the UE reduces to the finite sum 
Vn:p{F), containing (pi + 1) • • • {p^ + 1) terms. This is because = if ri > j^i or • • • or > p/^.. 
Set 

where the first column in the integrand stands for r repeated columns of (* ) , and similarly for the 
other columns. Set 

T^G [vri, ...,7rk]= r^G(l"" • • • 1"'"^' • • • l"^'^ • • • 1"'"^'') 
for vTi = (vTii • • • TTmii), . . . , vTfc = (vTifc • • • vTmfcfc)- (So, mfc is the length of the vector vTfc.) Set 

f[m • • • VTfc] = r^p[7ri • • • VTfc], f (^j- . . . ) = Tppiff ...), Tiff ...)= TM^f ■■■)■ 
Analogous to (|2.5p we have 

Vr = (n)-i • • • 2 cK) • • • c(vrfc)f [vri, . . . , 7r,]n™("^) • • • nf^'\ (2.9) 

The MAPLE procedures Vestsum(...) and Vest(...) in Appendix B calculate (j2.9p for any r and 
hence ()2.8p for any so estimates of bias of any order can be obtained. Let be the ith unit 
vector in R^. Then the first six Vrg of (j2.8p are 

Vo = T{F), 

k 
i=l 

k k 



% = Y.V2e, = -^Tp{f)/{n,-l), 



i=l i=l 



since Ve^+e. = for i 7^ j, 



i>3 = 5;t/3e. =2^f(.3)/(n,-l)2, 



1=1 i=l 



k 



k 

= E{24f (i^) - 20f{i^i^)n,}/{n, - 1)4 - 20 J] f - l)2(n, - 1)} 

i=l i^j 
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and 

k 

Vq = X]^6ei + ( 2 ) X]^4ei+2e,+ ( 3 ) Yl ^3e,+3e, + ( 222 ) Yl ^2e,+2e,+2ei 
1=1 iytj l<i<i<k l<i<j<l<k 

k 

= Yj {-120f + 90f {i^i'^)ni + 40f {i^i^)ni - 15f{i^i^i^)nf^ /{ui - 1)5 
1=1 

-15 j;{-6f (iY) +3f (iV/)n,/}{(n, - lUn, - 1)} 
+80 Y n^¥)/{K-l)2(n,-l)2} 

l<i<j<k 

-90 ^ f (i2//2)/|(^^ _ _ _ 

l<i<j<l<k 

By (|2.8p the above formulas give Vni^F) = J2r-0^r/rl as an estimate of T{F) with bias O(nQ^), 
where no = mini<j<fc nj. 

3 The S Estimate 

Here we derive the S form of UE, (II. ip . from the ^ estimate, (11.3p . 

Suppose first that A; = 1, (that is, univariate data). Then for r > 2, (n)rV^ is a polynomial in 
n = ni of degree [r/2], the integral part of r/2, say: 

K = (n)-i f/,,,(F)n^ = (n-l);_\ J]] Ur,j+i{F)n^ 

l<i<r/2 0<j<r/2-l 

for r > 2. Writing 

i 

n-' = ^[n - r + l]fc Cfcjv, (3.1) 

A:=0 

where [a]k = a{a + 1) • • • (a + /c — 1), we obtain 

Vr= Y Vri{F)/{n-l)u 

r/2<i<r 

where 

VriiF) = Y^ Cr-i-l,jrUrJ+l{F). 
0<j<r/2-l 

The MAPLE procedure cc(...) in Appendix B calculates the coefficients Ckjr in P-ip for any given 
k, j and r. It follows that the UE is 

00 00 
M) + 5]Vr! = ^5,(F)/(n-l)„ 
r=2 i=0 
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where So{F) = Vq = T{F) and 



2i 



Si{F) = yri{F)/r\ (3.2) 



r=i+l 

for i > 1. So, 

p-i 

SnpiF)=YS,iF)/{n-l), (3.3) 

i=0 

has bias 0{n~P). The MAPLE procedure Sest(...) in Appendix B can be used to calculate (j3.3p to 
obtain a bias of any order. Using (j3.2p . the first few Si{F) can be shown to be 

S^{F) = -r[2]/2, (3.4) 

S2{F) = T[3]/3 + r[22]/8, (3.5) 

S?XF) = -r[4]/4 + 3T[22]/8-r[32]/6-T[23]/48, (3.6) 
Si{F) = r[5]/5-2r[32]/3-3r[23]/16 + r[42]/8 + r[32]/18 

+r[322]/24 + r[2^]/384, (3.7) 
S^{F) = -r[6]/6 + 5r[42]/8 + 5r[32]/18-r[52]/10-r[43]/12 + 3r[2^]/64 

-r[422]/32 - r[3^2]/36 - r[32^]/144 - r[2V3840, (3.8) 
Sf^{F) = T[7]/7 - 3r[52]/5 - r[43]/2 + T[322]/140 + 127T[2^]/64 

-13r[422]/32 - 377r[3^2]/1008 + r[62]/12 + T[53]/15 + T[A^]/2,2 
-r[323]/48 + r[52^]/40 + r[432]/24 + r[33]/324 - r[2^]/160 

+r[3^22]/144 + T[42^]/192 + r[32'^]/1152 + r[2'^]/46080. (3.9) 

So, Sn2{F) = T(F)-(n-l)-iT[2]/2 has bias 0(^-2), 5„3(F) = Sn2{F) + {^-l):,\T[^]/^+T[2'']/S} 
has bias 0(n~^), and so on. 

Now suppose A; > 1, (that is, multivariate data). The UE 

OO OO 

r=0 ro=0 

can be written 

OO OO 

Y,Si{F)/{n-l)i = Y,Sf^^{F), 

i=0 40=0 



where 



^o^F)= E S,{F)/{n-\)i = 0{n^^-) 
t l=«o 

for riQ = mini<j<fc n^. An estimate of T{F) of bias 0{nQ^°) is 



po-l 

Snp,{F)=Y.Sl{F). (3.10) 

io=0 
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The MAPLE procedure Sest(...) in Appendix B can be used to calculate (j3.10p to obtain a bias of 
any order. For example, to obtain an estimate of bias 0{n^'^) one can show that 

S^{F) = T{F), 



S^{F) = -(l/2)j;r(f2)/(n,-l), 

i=l 



where 



Si = 5^{r(i3)/3 + r(iV)/8}(n,-l)2, 



i=l 



ill 



(1/4) T(iV){(n.-l)(n,-l)} 

l<i<j<k 



and 



where 



*S1 



21 



111 



In general 



QW/TTiN Q-i I C^l I Ciii 

'-'3 l-f^ J — '^n ~r 'Jfi ~r >Jn ) 

k 

^{-T{^)/A + 3r(i2i2)/8 - T{i^i'^)/6 - T{ei'^i^)/A8}/{ni - 1), 

i=l 

(-1/2) ^{r(.Y)/3 + r(z2iV)/8}/{(n. - l)2(n, - 1)}, 
(-1/2)3 ^ T(^Y/')/{(n. - l)(n,- - l)(n, - 1)}. 

l<i<j<l<k 

r 

5-(F) = J^S-, 



(3.11) 
(3.12) 
(3.13) 



(3.14) 



(3.15) 



where for vr = {ii,i2, ■ ■ ■), S^'^'^'" can be written down from the formulas for (F), (F), . . .: let 
us write 

5i(F) = J^di^TM, (3.16) 

TT 

where sums over partitions tt of {z + 1, . . . , 2i}. (Therefore many dij^ are zero.) Then 
5.n-.™ (F) = J] . • • di,^, • • • ^ r(jXi . • • j^-)/{{n,, - 1),, • • • (n,„ - 1),^}, 



TT IT 



where j'^ = j^^j^^--- and sums over ji,...,jm distinct in 1,...,A; with ji < jj+i if 

TTi = TTj+i. For example, 



Qn(rp\ _ q4 I qSI , q22 , c<211 qIIII 



(3.17) 
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where by ()3.7p . 

k 

£•4 = ^{T(i5)/5-2T(i3i2)/3_3T(i2i2^2)/;^g 

2 = 1 

+T(iV)/8 + T{i^i^)/lS + r(i3i2^2)/24 + r(i2i2i2^2)/3g4| _ ^^^^ 
and by (HH), dUD, 

5f = (-i/2)^{-r(iY)/4-3r(.2i2j-2)/i8-r(i3i2j-2)/6 

-T(i2i2i2j-2)/48}/{(n, - l)3(n, - 1)}, 

and by (|3.5p . 

= E m^¥)/9 + T(iViV)/64}/{K-l)2(n,-l)2} 

i<i<j<fc 

+2(l/3)(l/8)Er(z¥j')/{(n. - 1)2K- - 1)}, 

and by ([331), dM]), 

= (-1/2)2 ^ |_r(i3j-2^2)/3 + T{i'i'ff)/^}/{^n. - lUn, - l)(n, - 1)} 
and by ([33]), 

S-ii" = (-1/2)4 ^ T{i'j^fm')/{{n, - l){n, - l)(n, - l)(n^ - 1)}. 

l<i<j</<m<fc 

So, (I3l^ . (I33])-(I33]) provide the S'-estimate of bias O(nQ^). 

4 The T Estimate 

The T form of the UE, X^i^o -^*(-^)^~*' easily derived from the S estimate, but is less useful: its 
truncated form cannot be an UE for T{F) a polynomial in F, and the number of components in 
Ti{F) rapidly increases over the number in Si{F) as i increases. Since 

i oo 
i=l /3=0 

we have 

Gpi= E (4.1) 

oiH hai=/3 

and 

oo 

(n-l)-i = E^""^m> 

a=i 
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where 

Dai — Ga—i^i- ('i'^) 

The MAPLE procedures gbetai(...) and dalphai(...) in Appendix B calculate (j4.1|) and (j4.2p . 
respectively. Set Dai = D^^i^ ■ ■ ■ D^^i^, so Dij^^i = Gp^i^ ■ ■ ■ Gp^i^^. Then 



oo 

(n - l)ri = ^ DaiU 

a=i 



So, the UE is 



where 



and 



Note that 



i=0 a=0 r=0 



Ta{F) = YDaiSiiF) 
i=Q 



T;(F)= Ta{F)n-^ = 0{r 

{a'l=r} 



p-1 

TnpiF) = YV'iF) (4.3) 

r=0 



has bias Op{nQ ). The MAPLE procedure Test(...) in Appendix B can be used to calculate ()4.3 
to obtain a bias of any order. The first few {T^{F)} are 

T^{F)=T{F), 

k 

IT{F)= -{1/2) Yni')n;\ 

i=l 



^(^) = Y.^-T{i')/2 + Tiz')/3 + Tii^z^)/8}/im-l), 

i=l 

+(l/4)5]T(.Y)/{(n.-l)(n,-l)}, 



i<j 



jfiF) = ^{-r(i2)/2 + r(i3) + 3r(i2i2)/4_r(i4)/4 



i=l 



+ ^{T(i2/)/4 - Tii^f)/6 - T{i^z^ f)/16} 
i<j<i 
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and 



k 

T2{F) = ^{-r(i2)/2 + 7T{i^)/3 + 25T{ih^)/8 - 3T{i^)/2 
1=1 

-5T{r^f)/3 - 5T{i^i'^f)/16 + r(iV)/8 
+T{i^i^) /18 + T(i^i^i^)l2^ + T(i^i^i^i^)l?>8^n-^ 
-(l/2)^{-T(iY)/2 + r(i3/) 

i<j 

i<j<l<m 

5 Number of Computations Required 

As no = mini<j<fcnj — > oo, for fixed p the estimators of bias 0{nQ^),Vnp{F) of (j2.8p . Snp{F) of 
(j3.10p . and Tnp{F) of (j4.3p . all require O(no) calculations. This is in sharp contrast with bootstrap 
estimates of bias O(nQ^), such as that of (1.35) of Hall (1992), which requires ©(^q) calculations 
for the case k = 1 given there, and so at least this if generalized to k > 1. (Note that Hall's (1.35) 
should have a factor (—1)*"^^ inserted.) If one allows p to increase and counts the number of terms 
needed, then as shown by Table 5.1, Snp{F) requires increasingly fewer terms than do Vnp{F) and 

Tnp{F). 

[Tables 5.1-5.3 about here.] 

The number of terms in an expression of the form Yli<ii< - <im<k^n,ii---i„^ is Sm = {k)m/'rn- 
So, for general k one obtains the results in Table 5.2. For = 2, 3 this gives the results in Table 
5.3. 

6 Examples 

For k = 1 and p < 3, Snp{F) was given in Withers (1994a). For k > 1, Snop{F) and TnQp{F) in 
Withers (1994a) differ from Snp{F) and Tnp{F) given here. All have bias O(nQ^), but the forms 
given here are more natural. 

In this section we go over some of the examples of Withers (1994a) to obtain S estimates, 
Snp{F)^ of bias O(nQ^) up to p = 7. Recall that for = 1 this is given by 

p-i 

Snp{F) = Y,S^iF)/{n-l)i (6.1) 

i=0 
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for Si{F) of (133I)"(I3J]), and for A; > 1 by (l3lTO - (l3Tn) . We begin with two problems estimating 
a general function of the means of the distributions after initial given transformations of the data. 
When this function of the means is a polynomial of total degree po we show that for both prob- 
lems SnpoiF) is an UE. We then give examples estimating functions of central moments. We use 
the convention that repeated indices are summed over their range. For example, in (j6.2p below, 
ii • • • ji • • • are implicitly summed over 1, . . . , t. 

Example 6.1 k = I, T{F) = g{fi), where /i = / hdF = Eh{X) for X ~ F, where h : R" ^ and 
g : R^ ^ R are given functions. 

Assume that the partial derivatives of g{iJ,) are finite: 5ji---jv = "^ii " " " djrdif^)^ where dj = d/df^^ 
Then the general derivative of T{F) is Tp{xi ■ ■ ■ Xr) = gj^.-.j^^ij^xi • • • fJ'jrXr^ where fijx = /ij_p(x) = 
hj{x) — fij. So, 

T[tt] = gn-i^^j,-j^^...fi[k ■ • -^TTil^bi • • • jTra] • • • , (6.2) 

where fJ-[iii2 • • • ] = / {h{x) — ^)i^{h{x) — fi)i^ ■ ■ ■ dF{x), the joint central moment of h{X). Sub- 
stituting into (j3.4p - (l3.9p gives Si{F) for i < 6 so (16. ip gives an estimate of bias 0(n~''). Now 
for i > l,Si{F) has the form Ylr=i+i 9ji-- jr'^iji-jr- So, if g{fi) is a polynomial of degree p in /i 
(that is of degree pi in pi for 1 < i < t), then summation may be restricted to ji, ■ ■ ■ ,jr with 

Z]i=i Hji = a) < Pa for 1 < a < t, and Si{F) = for i > |p| = pi H \- Pt so Sn^\p\{F) is an UE. 

So, (|6.ip . (j3.4p - (j3.9p gives an UE for all polynomials g{p) of total degree seven or less. □ 

Example 6.1.1 g{p) = N'', where N = a' p for some t-vector a. If vr = (vri, . . . ,7rm) and r = 
TTi + ■■■ + TTm then T[tt] = {q)rN''a{Tri) ■ ■ ■ a{TTm), where a{i) = N'^aj^ ■ ■ ■ aj^p[ji ■ ■ ■ ji]. For 
example, a(2) = N~'^a'Va, where V = covar{h{X)}. So, a second order estimate of (a'fx)'^ is 
{a'p)'^{l — {^{a'p)~'^a'Va/{n — 1)}, where /2, y are the sample estimates of = h{X), and V. 

[Figures 6.1 and 6.2 about here.] 

Now suppose q = t = 2, a = (ai,l — ai) and V = l2- The second order estimate reduces 
to {ai'pi + (1 — ai)/l2}^ — {«! + (1 — ~ !)• If ^i^) is bivariate normal with unit 

means and the given V then the target estimator (Cabrera and Fernholz, 1999, 2004) of (a'p)^ is 
{ai/ii + (l — ai)/l2}^ — {ai + (l — cei)^}/"-- Sen (1988)'s asymptotic normality provides u), the maxi- 
mum likelihood estimate of w given (a'/2)^ ~ X{io, (3/n){Qf + (1 — ai)^}^ + (4a;/n){af + (1 — ai)^}). 
Figures 6.1 and 6.2 compare the performance of these three estimates and those obtained by boot- 
strapping and jackknifing. Our estimate has the lowest absolute bias and the lowest mean squared 
error. The estimates due to Cabrera and Fernholz (1999, 2004) are so close to ours that they are 
indistinguishable. 

Next suppose t = a = 1 so T{F) = p'^, p = Eh{X), a{i) = p^^Pi, Pi = E{h{X) — pY and 

= (Q')r/i'^~'"/U7ri - /U7r„- AlsO for 1 > 1, 

2i 

= E iQhf^'-'Sir, (6.3) 
r=i+l 

where Su = -^2/2, = Ms/S, = Aii/8, S'34 = -p4, + 3|U^/8, = -^3^2/6, 536 = -/^l/^S, 
'S'45 = ^5/5 - 2^3/i2/3, 546 = -3/i|/16 + P4P2/8 + pI/18, 847 = psp^AS, S48 = ^1/384, ^56 
= -pe/G + 5/U4/i2/8 + 5/i|/18, ^57 = -P5P2/W - piP3/l2, S58 = 3/U24/u^/32 - /u|/i2/36, ^59 = 
-P3pyu4, 55,10 = -/x|/3840, 567 = ^7/7 - 3//5M2/5 - ^4^3/2 + ^3^1/140, 568 = 127^|/64 - 
13//4/^i/32-327//2/x2/100 + //6M2/12 + ^5/W3/15 + Ml/32, 569 = -7/i3Mi/48 + /U5Aii/40 + ^4^3Ai2/24 + 
^1/324, 56,10 = -py 160 + pIpI/UA + p4py 192, Se,ii = /i3^|/1152 and 56,i2 = ^1/46080. This 
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gives Si{F) for i < 6 and so 5„7(F) of bias 0{n '^). If g is a positive integer, then Si{F) = for 
i > q so Snq{F) of ()6.ip . (j6.3p is an UE of /i"?. For example, an UE of is given by ()6.ip with 
= -6/iV2, 5*2 (F) = 8/i/i3 + 3//^, SsiF) = -6^4 + 9//!. This result may be checked by solving 
the system of seven equations given by Wishart (1952, page 5). Alternatively one may follow the 
method of Stuart and Ord (1987, Section 12.22) using their tables of the symmetric polynomials. 
For example, one obtains the UE r„(F) for fi'^, where 

(n — l)^Tn{F) = {n'^ — 8n^ + 23n — 30)m4 — n(n^ — 7n + 4)m3mi — n(n^ — 6n + 6)m2 
where rrii = EX"^ . Clearly our method gives the simpler form. □ 

Example 6.1.2 t = 2, g{^) = ^xi^i^^ . Then 5^2^ = {-'^V j^- l^2^~^^ = o-j say, = l^io-j, and = 
unless TT is a permutation of 2^ or 12-^ for some j. For tt = (tti, 712, . . .) set |7r| = tti + 7r2 + • • • and 

= ^W/(M7ri/^7r2 • • • ) = E{X^Jfl^^ - l){X^Jfl^^ - !)■■■ . 

Then 

= /ii^2-^(-l)Wa[2^i]a[2^2] • • • {|7r|! - (|7r| - 1)! 7r,a[12^»^ V«[2"1}. 

i 

So, 

Si{F)/T{F) = a[l2] - a[22] = FXiX2/(^iM2) - ^^I/mI, 

S2{F)/T{F) = -2a[222] + 2a[122] + 3a[22]2 - 3a[12]a[22], 

S3{F)/T{F) = 6q[123] - 6a[2^] - 9a[12]a[22] + 9a[222] 

+20a[2^]a[2'^] - 12a[12'^]a[2'^] - 8a[23])a[12] 
+15a[12]a[22]2 - 15a[22]^ 

Si{F)/T{F) = 24a[12^] - 24a[25] + 80a[2^]a[2^] - 48a[122]a[22] 
-32a[23]a[12] + 45Q[222](a[12] - a[22]) 
+900(2"^] a [2^] - 60a[123]a[22] - 30a[2^]a[12] 
+A0a[2^]{a[2^] - a[l2^]) - 2Wa[2^]a[2'^f + 90a[12'^]a[2^f 
+120a[23]a[12]a[22] + 105a[22]3(a[22] - a[12]), 

S5{F)/T{F) = 120a[125] - 120a[2*'] + 150a[2^](3a[22] - q[12]) 
-300a[123]Q[22] + 200a[2^]{a[2^] - a[12'^]) 
+72Q[2^](7a[23] - 3a[123]) - 360a[12^]a[23] 
+60Q[2^](7a[23] - 3a[122]) - 240a[123]a[23] 
+1890a[22]^(a[22] - a[12]) + 630a[24]a[22](a[12] - 2a[22]) 
+630a[123]a[2Y + 210a[23]2(a[12] - 4a[22]) 
-630a[122]a[23]a[22] + 945a[22]4(a[12] - a[22]) 
+840a[22]2(3a[23]a[22] _ a[122]a[22] - 2a[23]a[12]), 

and similarly for Sq{F). 
[Figures 6.3 and 6.4 about here.] 

It follows that a second order estimate of /ii//x2 is {Xi/X2){l + n~^ [XiX2/{Xi X2) — X2 / X-i']} , 
where Xi and X2 are the sample means for Xi and X2, respectively. If Xj, i = 1, 2 are independent 
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exponential random variables with means fXi, i = 1,2 then a target estimator (Cabrera and Fernholz, 
1999, 2004) of ^i//U2 is {in2 — l)/n2){Xi/X2), where 77-2 denotes the sample size for X2. Sen (1988)'s 
conditions for asymptotic normality do not hold here. Figures 6.3 and 6.4 compare the performance 
of the two estimates and those obtained by bootstrapping and jackknifing. Our estimate again 
provides the lowest absolute bias and the lowest mean squared error, but the differences with 
respect to the target estimator do not appear to be significant. □ 

Example 6.2 T{F) = g{fi), where /x = {m, . . . , jik), /Xj = J hidFi = Ehi{Xi) for Xi ~ _Fj, hi : 
R^"- R is a given function, and g : R^ R is a. given function with finite partial derivatives 
9ji-jr- Then 

Xl ■■• ) ~ 9il---irl^ilXl ' ' ' l^irXrl 

where pLix = IJLiFiix) = hi{x) - /Xj. So, 

r(i"/ . . . ) = giajb...Ha[i]t^b[j] ■■■ , 

where /Xa[«] = fia{hi{Xi)) = J{hi{x) — ^iYdFi{x). An estimate of bias O(nQ^) is Snp{F) = 
HZl SnF), where by dSHJ-dMlD, 

S^{F)=g{^^), 
k 

5r(F) = -(l/2)^ft,2/X2W(n, - l)-\ 
1=1 

k 

S2iF) = j;te3M3W/3 + 5^4^2[f/8}(n,- 1)2-1 
j=i 

+ ^ 9i2j2fi2[i]f^2[j]{ni - ly^iuj - ly^/A, 

l<i<j<k 

k 

SsiF) = j;{5^4(-^4W/4 + 3^2WV8) - giSfi3\i]fi2\i]/Q - 5i«^2[f /48}(n, - 1)3-^ 

i=l 

- ^{9i3j3fJ^3\i]l^3[j]/^ + 5i4j-2M2WV2[i]/16}(ni - l)2^{nj - 1)"^ 

-(1/8) 9i^pPfJ'2[i\f^2[j]fJ-2[l]{ni - ly^irij - l)-i(n/ - 1)"^ 
i<j<l 
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and 

k 

ffi{F) = J2{g,,{^l5W5-2^ls[^\^^2[i\/S) 

+ff,6(^4WV8 + /^3[f /18-3^2[f /16) 

-(1/2) ^te4,-2(-//4[i]/4 + 3M2[i]Vl8)M2b1 

-gi5j2ij,3[i]fi2['i]iJ-2\j]/G + gi6J2^i2[^\^^J-2[j]/'^8}{ni - 1)3 ^(n^ - 1)~^ 
+ X]{^^'i^^3[i]y^3b1/9 + ftV//2[i]^M2bf /64}(ni - 1)2 - 1)2^ 

i<j 

+ ^9i3j3H3[i]l^3[j]ini - 1)2 ^(%- - l)^Vl2 

+ {5i3j2p/i3[i]/X2b>2[^]/12 

+5'i4j2p^4[i]2//2b1/^2[^]/32}(nj - 1)2 - 1)"^"; - 1)"^ 

+ XI Si2pPm2l^2{i\l^2{j]l^2{l]l^2[m]{ni - l)~^{nj - iy\ni - l)"^(n^ - ly^/lQ- 

i<j<l<m 

As in Example 6.1, for i > 1, Sf{F) has the form Yl^—i+i 9ji-jr(^ji---jr- ^ polynomial 

of degree p in /x (that is degree in for 1 < z < /c), then 5„|p|(F) is an UE of g{iJ,) for |p| =p'l. 
□ 

Example 6.2.1 g{fi) = N^, where N = a'n for some /c-vector a. Then 

5n-ir- = iq)rN'^~''ah ■■■air- 

So, 

n^"/---) = (9).iV^"'^a„[i]«;.b]--- , 
where r = a + b + ■ ■ ■ , aa[i] = affia[i], and for i > 1, 

2i 



r=i+l 



where 



'5r2 = -E"2M(^.-l)'V2, 



523 = E«3H(^i- 1)2-73, 
i=l 

k 

1=1 i<j 
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k 

= ^(-"4^/4 + 3a2[f /8)(n, - 1)3 \ 

i=l 

k 

S?5 = -^a3[i]a2[i](ni-l)3V6, 

i=l 

k 

S^, = -5^a2[if(n,- 1)3-1/48 

i=l 

- J2{»3[i]as\j]/6 + «2H'a2[j]/16)(n, - l)^\nj - l)'^ 

- a2[i\a2\j]a2[l]{ni-l)-\nj-l)-\ni-l)-^/8, 

i<j<l 

k 

S45 = ^(a5[i]/5-2a3[i]a2[i]/3)K-l)4i, 

i=l 

k 

S2e = ^(a4[i]Vl8 + a3[i]Vl8-3a2[i]Vl6)(ni-l)ji 

i=l 

-^(-a4H/4 + 3a2HVl8)a2L7lK - 1)3 - 1)~V2 
+ J2a3\i]a3[j]{ni - l)^\nj - 1)^^/9, 

i<j 

k 

S47 = Xl«3H«2[i]^K-l)4"V384 
i=l 

+ Xl"3[i]{a2[i]a2[i](n, - 1)3-1(71,- - 1)-^ + a2bf K " 1)2 " 1)2"'}/12 
+ J] «3H«2L7laiWK - l)2\nj - l)^\ni - 1)^^/12 

k 

S28 = ^a3[i]'(ni-l)jV384 

i=l 

+ ^«2[f a2L7lK - 1)3 - 1)~V96 

+ ^a2[f a2L7f K - 1)2"'(%- - 1)2 V64 

+ Yl a4[i]a2bMl]ini-l)2\n,-l)-Hni-l)-^/32 

+ Y a2[i]a2\j]a2[l]a2[m]{ni-l)-\nj-l)-\ni-l)-\nrn-l)-^/lQ. 

i<j<l<m 
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For example, a second order estimate of {a' jiY is 

^ ^ i=l 

where {liiVi are the sample estimates of = At2[^], the mean and variance of hi{Xi). □. 

Example 6.2.2 k = 2, g{^) = /xi/X2/(/^i + A*2)- Set D = + /X2- Then ^(/x) = 1 — /x^-D"^ so 
giaH2^ = g2'^lH^ = (— -D)~"~^a!. Also since 112 = {D — /xi)^, 

5^„26 = -(-I))"''"''"^^ + b- 2)!{(6^ - - 2baniH2 + (a^ - a)/x^}. 

So, 

Sf{F) = T{FfD-^j2^Jifpi2\i]{n,-l)-\ 

1=1 

2 

i=l 

+D-^{n\ + 4^i^2)/i2[l])U2[2](ni - l)-\n2 - 

S^{F) = r(F)2^Mr'{^-'(6)"4[i]-9M2[f) 

1=1 

+20D-^f^3[i]^i2[i] + l5D-^fi2[i]^}{n^ - 1)3 ^ 

-48D~\,4 + 3/xi/X2)M3[l]M3[2]{(ni - 1)2-^(7x2 - 1)"^ 

+(ni-l)-i(n2-l)2-'} 

-3L>-^(/x? - 8/X1/X2 + 6/xi)/X2[l]V2[2](ni - l)^\n2 - l)"' 
-3D-\6nl - 8/X1/X2 + /xi)/X2[2]2/x2[l](n2 - l)^^(ni - 

and so on. □ 

Example 6.3 A; = 1, T{F) = Hr = l^riKX)) = E{h{X) - , where = Eh{X) for X ~ F and 
h : ^ R a given function. By (5.6) of Withers (1994a), its general pth order derivative is 

p p 

HrF{xi ■■■Xp) = {-iy{{r)pHr-p - {r)p-l Yihl~^ - fir-p+lK^)} J| hj, 

i=l j=l 

where hi = fJ,F{xi) = h{xi) — jjl. So, T[iii2 • • • ] = T{W^ • • • ) and Si{F) for z < 3 are as given there. 
For example, 

T[i] = {-iy{{r)ilJ,r-ilJ,i-i{r)i-i{lJ.r- IJ-r-i+llJ-i-l)}, 

r[4] = (r)4/Xr-4/X4 - 4(r)3(/Xr - /Xr-3/^3), 

r[5] = -(r)5/Xr-5/^5 + 5(r)4(/Xr-/Xr-3/^3), 

r[42] = (r)6^r-6^4M2 - 2{r)5{-2flr-5H3tX2 + /J-r-AfJ-A + 2/Xr-2/^2}, 

^[3^] = (^^)6Mr-6/^3 - 6(?-)5(^r-3^r-5M2)^3, 

T[32^] = - {r)THr-7fJ'3lA + {rhi-^IJ'r-GlA + 4Mr-5)"3)"2 + Sfir-AlA}^ 

T[2^] = (r)8Mr-8At2 - 8(r)7//r-6Mi. 
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So, 

8 

1=0 

where S^-q = (r)4, S^^i = 0, 54-2 = -r(r-2)2/i2/2, 54-3 = -r{r-?>)nz/?>, 54_4 = -r^ii + r'^ nl/S, 
54-5 = -Ai5/5 + (r + 4)/i3//2/6, ^4-6 = -3^1/16 + ^4/^2/8 + //i/18 - r/i3/48, 54-7 = -/i3/^i/24 
and 54-8 = ^2/384. The fifth order 5 estimate is now given by (j6.ip . Also by Example 5.3 of 
Withers (1994a) one can now obtain an UE for ^u^ for r < 9. Obtaining ^5, from (j3.8p ~ (j3.9p one 
can obtain an UE for ji^ for r < 12. Our results agree with those of James (1958, page 6): by a 
different method he obtained an UE for fir for r < 6. □ 

For T{F) a function of a central moment, one may apply the chain rule, as illustrated in the 
next example for the case T{F) = a = [i-l"^ ■ 

Example 6.4 Here we specialise an application of the chain rule given in Appendix A of Withers 
(1994a). Suppose A: = l, is a function with finite derivatives and TiF') = g{S{F)), where 

S{F) is a smooth univariate functional. Set gr = g^^\S{F)). The third order S estimate of T{F) 
is given by (|6.ip . (j3.4p . (j3.5p in terms of 



r[2] = <725(l,l)+5i S[2], 
T[3] = 535(1, 1,1) +3525(1,12) + 51 5[3], 
T[22] = 545(1,1)2 +53{25(1,1)5[2]+ 45(a6, a, 6)} 

+52{45(a, ab^) + 5[2]2 + 25(a6, 06)} + 51 5[22] 



where 



5(1,1) = j Si 5(1,1,1) = j Si 5(1, 1^) = js^S,,, S{ab,a,b) = J j S^y S, Sy, 



S{a,ab) = J J Sx S^yy, S{ab,ab) = J J S^y, S^y... = Sp {x,y, . . .) 

and integration is with respect to F[x) and F{y). 

Take T{F) = cr, that is 5(F) = /i2 and g(s) = s^^"^. Then 5^ = (1/2)^^2^^ where (r)j = 
r!/(r — fi^ = x — fi, ii2x = ~ M2, ^J'2xy = —'^l^xfJ'y, and higher derivatives vanish. So, 
5(1,1) = fii- Mi, 5[2] = -2^2, 5(1,1,1) = fie- 3/^4^2 + 2^1, 5(1, 1^) = -2(/i4 - /^i), 5[3] = 
S{a,ab'^) = 5[22] = 0, S{ab,a,b) = —2^3 and S{ab,ab) = 4//2- Setting f3r = /^2 ^2*^^^' obtain 
5i(F)/m2^^ = (^4 + 3)/8 and S2iF)/fil^^ = (16/?6 + 22 /34 + 164 - 15/3|)/128. 
[Figures 6.5 and 6.6 about here.] 

It follows that a second order estimate of a is a{l + (l/(n — l))(l/8)(/34 + 3)}. Suppose now F 
is exponential with mean a. Then a target estimator (Cabrera and Fernholz, 1999, 2004) of a is the 
sample mean X. Sen (1988)'s asymptotic normality provides tD, the maximum likelihood estimate 
of Lo given a ~ N {uj , uj"^ / n) . Figures 6.5 and 6.6 compare the performance of these three estimates 
and those obtained by bootstrapping and jackknifing. Our estimate again gives the lowest absolute 
bias and the lowest mean squared error. □ 

We end this section with examples of functions of more than one moment. These appeal to 
some results given in Withers (1994a). 
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Example 6.5 k = l,T{F) = §{^,112) for /i = EY,ii2 = E{Y - fi)^,Y = h{X), given h : R' ^ R 
and g : R^ ^ R with finite derivatives Qj^ - j^ = dj^ ■ ■ • dj^g{Ui,U2) at Ui = fi, U2 = ^2, where 
di = d/dUi. We give the fourth order S estimate for general g, then speciahse. Note that Si{F), 
S2{F), SsiF) are given by (I331)-(I3S1) and (A14)-(A15), (A20)-(A23) of Withers (1994a). Set 

Uij„{a^b-^..,a^b^..,..) = j j ..Uipia^h-^ ..)UjF{a^h^ ■■)-dF{a)dF{h)... 

Allowing for permutations the nonzero terms needed are as follows: 

• for r[2]: at (a^), U2 = -2/^2; at (a, a), Uu = /i2, U12 = ^3, t^22 = P-a- fJ-h 

• for r[3]: at (a,a^), U12 = -2^3, U22 = -2(/i4 - ^2); at (a, a, a), Um = fis, Uu2 = /U4 - fJ-l, 

U122 = /is - 2/U3/i2, ^^222 = /i6 - 3/^4/^2 + '^fJ'h 

• for T[22] : [722(06,06) = 4/i|; at {ab,a,b), U211 = -2/i^, C/212 = C/221 = -2/^2^3, C^222 = -2^/3; 

• for r[4] : U22{a?,a^) = 4/i4; at (0,0,0^), U112 = fJ-4. - /U^, ^7i22 = -2(/U5 - /i3At2), f^222 = 

-2(//6 - 2/i4/i2 + M2); at (o, O, O, o), Uiu = fJ.4, Uuu = ^5 - /i3/W2, t^ll22 = l^Q- 2/^4/^2 + ^4,■> 
C^1222 = /i? - 3/i5/i2 + 3//3/i|, f72222 = fJ-S - 4/^6/^2 + 6/^4/^2 " 3/i|. 

• By (A14), r[32] = T{a?b^) = J2k=i^23.k say, where z/23.1 = z^23.2 = 0. For 2^23.3: at {a,ab,b'^), 
C/122 = 4/i3//2, ^222 = 4/i|; at {b,ab,ab), U122 = 4//3/i2, f/222 = 4(/i4 - //2)/^2- For 1/23.4: at 

{ab,a,b,b), U2IU = -2/i3/i2, t^2112 = -2/i2(Ai4 - /^l)) ^2122 = -2/i2(At5 - 2/X3/i2), C^2212 = 
-2/Z3(/l4 - Ptl), f^2222 = -2/i3(/"5 " 2/i3/^2)- 

• By (A15), r[23] = T{a%'^^) = Y%=i V222.k, where 1/222.1 = 1^222.2 = 0. For 1/222.3 = 9*ifc^3^'^: 
U222{ab,bc,ca) = -8/i|. For 1/222.4 = gijuB''^^^: at {a,b,ab), Uiu = -2/i|, [/122 = -2/i3/i2, 
?7222 = -2/u|; at {a,b,ac,bc), Uu22 = '^fJ'l^ f^i222 = 4/X3/x|, C/2222 = 4/i|/i2. 

Other components are covered by the above Uij.... □ 

Example 6.5.1 g{fi,fJ.2) = fJ'fJ'2^^^ = /? say Let (3r = /"2'^^Vr- Then 5i(F), 52(F), r[4] = T{1^) 
and r[22] = r(l2l2) are given by Example 5.6 of Withers (1994a). So, 53(F) is given by ([Ml) - and 
hence the fourth order 5 estimate - once we specify r[32] = ^^^=3 i^23.A: and r[2'^] = Ylt=3'^222.k- 

]^ /2 3/2 5/2 

Since gi = > 52//^ = 912 = — ^^2 /2> 522//^ = 5122 = 2/^2 /4, and so on, these components 
are given by 

1^23.3 = 45/?3 - 15/3(2/3| + 3/34 - 3)/2, 
i^23.4 = 45(3/35 - 6/33 + 7/34 - 7) /4 

-105/3{/36 - 3/34 + 2 + 12/33 (/35 - 2/33) + 6(/34 - 1)'}/16, 
z/23.5 = 105{2/33(/?6- 3/34 + 2) +3(/34-l)(/35 - 2/33)1/16 

-945/3(/34 -l)(/36 - 3/34 + 2)/32, 
1^222.3 = -775/3, 

1.222.4 = 45{-y5/33 + 7/3(/34 - 1 + 4/3|)/4}, 

1^222.5 = 315{-3(/34 - l)/33 + /3| + 3/?(/34 - l)(/34 - 1 + /3|)}/16, 

1.222.6 = 945{-12(/34 - 1)2/33 + ll/3(/34 - l)=^}/64. 

[Figures 6.7 and 6.8 about here.] 
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It follows that a second order estimate of iij ^f]l2 is A*/a/a*2 — (l/'^){/93/2+ (l/8)(/x/y^)(3/94 + 
1)}. Suppose now Y = h{X) is normally distributed with mean /Lt and variance /X2- Then a target 
estimator (Cabrera and Fcrnholz, 1999, 2004) of /Lt/y^is \/2r((n-l)/2)y/{V^r=Tr(n/2-l)5y}, 
where Y and Sy denote the sample mean and the sample standard deviation, respectively. Sen 
(1988)'s conditions for asymptotic normality do not hold here. Figures 6.7 and 6.8 compare the 
performance of the two estimates and those obtained by bootstrapping and jackknifing. Our esti- 
mate again provides the lowest absolute bias and the lowest mean squared error, but the differences 
with respect to the target estimator do not appear to be significant. □ 

Example 6.6 k = s = 1, T{F) = 5(^2, /"s) for = ^J'r{X), X ~ F and g having finite derivatives 

9ij - = {d/diii){d/dixj) ■ ■■g{fi2,fi3). 

By Example 6.3, = f4 - /"3 - 3f^2f^x, f^3xy = -3(/Ux + fiy){iix^iy - /U2), ^^3xyz = 12fixfiyfiz- Now 
use (A8-A11) of Withers (1994a) with Ui{F) = fif. for T[2] we need U3{a'^) = -6/1/3, ^^23(0, a) = 
IJ.5 - 4/i3^2, C^33(a, a) = fiQ- 6^4/U2 - l4 + 9^1- This gives 

T[2] = -2g2fJ,2 - 653/^3 + 522(^4 - f4) + 2^23 (y"5 - 4//3M2) + 333(^6 - 6/^4/^2 - Ms) + 9^2- 
For T[3] we need 

U3{a^) = 12/i3, 

t^23(a,a^) = -6(^5-2^3/^2), 

t^32(a,a^) = -2(//5 -4^3^2), 

^^33(0, a^) = -6(//7 - 4^5^2) - ^4M3 + 4//3//I, 
U223{a,a,a) = - 5//5Ai2 - A*4/^3 + 8//3M2! 
t^233(a, a, a) = /xs - 3/X6/Lt2 - 2//5/X3 + 15//4/x| + 4/i^/X2, 
t^333(a, a, a) = fJ-d - 9/X7/^2 - 3/^6/^3 + 27//5/x| + I8//4//3//2 + 2//| - 135/X3//2- 

This gives 

r[3] = I253//3 - 6322 (/^4 - /^2) - 12323 (2/i5 - 5/^3/^2) 
-18£?33(/X7 - 4//5/X2 - M4M3 + ^/Xs/^l) 

+5222(A«6 - 3//4At2 + 2/X2) + 3c?223(/^7 - 5/X5//2 - /X4/X3 + 8//3//2) 

+5233^^233(0, a, a) + 5333C^333(a, a, a). 

For r[22] we need 

U23{a,ab'^) = I2fi3fj,2, 
U33{a,ab^) = 12(//4 - 3/x|)/X2, 
U23{ab,ab) = I2/X3//2, 
[733(06, a6) = 18(//4/X2 + /^i - lA), 

and at (a6, a, b): 

U222 = — 2/x|, 

C^223 = f^232 = — 2/X3K4, 

C/233 = -2i4, 

U322 = -6/X3(/X4 - //2), 

U323 = U332 = -3{(/X4 - l4)l^4: + /X3(/X5 - 4/X3/^2)}, 
C^333 = -6^4(^5 - 4/X3/X2). 
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This gives 



r[22] = 12(722CT^ + 48523CT^/33 + I2g^za\7 [3^ + 6/3| - 15) 

-45233^^'(/36 + 12/35/?3 + 2/3| - 42/?4 - 49/3| + 9) 
-12ff333CT^{(/?6 - 14/34 - /3| + 33)/33 + 2(/34 - 

+92222a\Pi - if + 4.g2223Cr^{p5 " " 1) 

+252233(t'°{(/36 - 6/34 - /3|)(/?4 - 1) + 2(/35 - 4/33)'} 

+452333fT"(/35 - 4/33)(/36 " 6/34 - /3|) + 53333fT''(/36 " 6/34 " Plf, 

where again Pr = cr~^'fir- By ()3.4p . (|3.5p this gives Si{F) and S2{F) so that (|6.ip gives the third 
order S estimate. □ 

3/2 

Example 6.6.1 g[fi2,fJ'3) = ^3^2 ' skewness of F. One obtains 

T[2] = -3/35 + 15(/34 - l)/33/4 + 9/33, 

T[3] = -105(/36 - 3/34 + 2)/33/8 + 36/35 - 45/34/33/2 - III/33/2, 
r[22] = -105(/35 - 4/33)(/34 - l)/2 + 945(/34 - 1)2/33/16 + /335, 

where 6 = 78 - 105(/34 + /3|) - 15(2/35 + I3/34/33 - 29/33). Note that T[2] for both skewness and 
kurtosis were first given in Withers (1994b): /3i in (|3.ip there should be Pi+r- D 
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Appendix A 



Here we explain the infinitesimal jackknifc given in the unpublished report Jacckcl (1972) and its 
relation to our case p = 2,k = 1. In fact he offers two forms and these are equivalent to our second 
order S and T estimates, but arc arrived at without using functional derivatives. 

He considers the case A; = 1 for T(F) but with F{x) the weighted empirical distribution, F(x) = 
Yl^=i WiI{Xi < x). His first form is equivalent to our T estimate with 

n 

T^{F) = -(l/2)n-i Yl d''T{F)/dw1 

i=l 

evaluated at u;i = • • • = = 1/n. His second form is essentially our S estimate and is defined in 
the same way except that in the definition of the weighted empirical distribution Wi is replaced by 
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Appendix B 



The following procedures in MAPLE calculate the V, S and T estimates described in Sections 2 
to 4 to obtain bias of any given order. The electronic versions of these procedures can be obtained 
from the corresponding author. 

#this procedure expresses the first u symmetric polynomials in terms of power 

#sum functions the output from this procedure is needed as input for 

#the VestO and VestsumO procedures 

symmpoly := proc(u) 

local m,e; 

e[0] :=1; 

for m from 1 to u do 

e[m] :=(l/m)*sum((-l)**(i-l)*e[m-i]*p[i] ,i=l. .m) ; 
od; 

return ( [seq(e [mm] ,mm=l . .u)] ) ; 
end proc; 

#this procedure computes the G function given by (4.1) 
gbetai := proc (beta.i) 
local tt,ttt,ii, j ,k,p; 
tt:=0; 

for ii from 1 to i do 
p:=composition(beta,ii) ; 
for j from 1 to nops(p) do 
ttt:=l; 

for k from 1 to ii do 
ttt:=ttt*k**(p[j] [k]) ; 
od; 

tt:=tt+ttt; 

od; 
od; 

return (tt) ; 
end proc; 

#this procedure computes the D function given by (4.2) 
dalphai := proc (alpha, i) 
gbetai ( alpha- i , i) ; 
end proc; 

#this procedure computes the coefficients c[k,j,r] given by equation (3.1) 
cc : = proc (k, j , r) 
local d,tt,i,n; 
d[j] :=1/Amkr(j,j,r); 
tt:=d[j] ; 
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if (j>k) then 

for i from 1 to (j-k) do 

d[j-i] :=0; 

for n from (j-i+1) to j do 

d[j-i] :=d[j-i]+d[n] *Amkr(j-i,n,r) ; 

od; 

d [ j -i] : =-d [ j -i] / (Amkr ( j -i , j -i , r ) ) ; 
od; 

tt : =d [k] ; 
end if ; 
return(tt) ; 
end proc; 

#the following procedure is needed as part of the above cc (k, j, r) procedure 
Amkr := proc (m, k, r) 

sum(((-l)**(l+k))*stirlingl(k,l)*binomial(l,m)*(l-r)**(l-m) ,l=m. .k) ; 
end proc; 

#this procedure computes the k (ndim) fold summation in equation (2.9) 
#here it is assumed implicitly that k=5 

#but the procedure can be applied for any k by making appropriate changes to 
#the five do-loops and the five statements following it 

#this procedure requires as input: n[l] ,n[2] , . . . ,n[k] ,r[l] ,r[2] , . . . ,r[k] , 

#ndim=the value of k,the output from symmpolyO and the T(.) function 

#in equation (2.4) the output from this procedure is needed as input for 

#the VestO and coef f icients () procedures 

Vestsum := proc (ndim.n: :list,r: :list,e: :list,T) 

local kk , pa , ss , i 1 , i2 , i3 , i4 , 15 , paa , bb , tt , kkk , j , nn , ttt , mmm ; 

for kk from 1 to ndim do 

pa[kk] :=partition(r [kk] ) ; 

od; 

ss :=0; 

for il from 1 to nops(pa[l]) do 

for i2 from 1 to nops(pa[2]) do 

for i3 from 1 to nops(pa[3]) do 

for i4 from 1 to nops(pa[4]) do 

for i5 from 1 to nops(pa[5]) do 

paa[l] :=pa[l] [il] ; 

paa [2] :=pa[2] [12] ; 

paa [3] :=pa[3] [13] ; 

paa [4] :=pa[4] [14] ; 

paa [5] :=pa[5] [15] ; 

bb:=member(l,paa[l] )=false; 

for kk from 2 to ndim do 

bb:=bb and member (1, paa [kk] )=false; 

od; 
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if (bb) then 

for kk from 1 to ndim do 

tt [kk] : =expaiid(e [r [kk] ] ) ; 

od; 

for kkk from 1 to ndim do 
for j from 1 to r[kkk] do 
nn : =0 ; 

for kk from 1 to nops (paa [kkk] ) do 

if (j=paa[kkk] [kk] ) then nn:=nn+l end if; 

od; 

if (nn>0) then tt [kkk] :=coeff (tt [kkk] ,p[j] ,nn) end if; 

od; 

od; 

ttt:=l; 

for mmm from 1 to ndim do 

ttt : =ttt*tt [mmm] * (n [mmm] ) ** (nops (paa [mmm] ) ) ; 
od; 

ss :=ss+ttt*T( [seq(paa[mm] ,mm=l . .ndim)] ) ; 

end if ; 

od; 

od; 

od; 

od; 

od; 

ss : =expand(ss) ; 
return (ss) ; 
end proc; 

#this procedure computes of the coefficients of the output from 
#with respect to powers of n[l] ,n[2] , . . . ,n[k] 
#It is assumed implicitly that k is 5 

#the procedure can be applied to any k by changing the number 
#of do loops and making other appropriate changes 

#this procedure requires as input: n[l] ,n[2] , . . . ,n[k] ,r [1] ,r[2] , . . . ,r[k] 
#and the output from VestsumO 

#the output from this procedure is needed as input for the SestO 
#and TestO procedures 

coefficients := proc(n: :list,r: :list,ss) 
local il,i2,i3,i4,i5,sss,A; 

A:=array(l. .r[l]/2,l. .r[2]/2,l. .r[3]/2,l. .r[4]/2,l. .r[5]/2) ; 

for il from 1 to r[l]/2 do 

for i2 from 1 to r[2]/2 do 

for i3 from 1 to r[3]/2 do 

for i4 from 1 to r[4]/2 do 

for i5 from 1 to r[5]/2 do 

sss:=coeff (ss,n[l] ,il) ; 

sss:=coeff (sss,n[2] ,i2) ; 
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sss :=coef f (sss ,n[3] , i3) ; 

sss:=coeff (sss,n[4] ,i4) ; 

sss : =coef f (sss ,n [5] , i5) ; 

A[il,i2,i3,i4,i5] :=sss; 

od; 

od; 

od; 

od; 

od; 

return (A) ; 
end proc; 

#this procedure computes V_r for the V estimate in Section 2 
#this procedure requires as input: n[l] ,n[2] , . . . ,n[k] ,r[l] ,r[2] , . . . ,r[k] , 
#ndim=the value of k,the output from symmpolyO and the T(.) fimction 
#in equation (2.4) 

Vest := proc(ndim,n: :list,r: :list,e: :list,T) 
local ss.mm; 

ss:=Vestsum(ndim,n,r,e,T) ; 

ss : =ss* (product (f actorial(n[mm] -r [mm] ) ,mm=l . .ndim) ) ; 
ss :=ss/ (product (factorial (n [mm] ) ,mm=l . .ndim) ) ; 
ss : =simplif y(ss) ; 
return(ss) ; 
end proc; 

#this procedure computes V_r for the S estimate in Section 3 
#It is assumed implicitly that k is 5 

#the procedure can be applied to any k by changing the number 

#of do loops and making other appropriate changes 

#this procedure requires as input: n [1] ,n [2] , . . . ,n [k] , 

#r [1] ,r [2] , . . . ,r [k] and the output from coef f icientsO 

Sest := proc(n: :list,r: : list, A: : array) 

local il , i2 , i3 , i4 , i5 , j 1 , j 2 , j 3 , j 4 , j 5 , tt , ttt , ss ; 

ss:=0; 

for il from r[l]/2 to r[l]-l do 
for i2 from r[2]/2 to r[2]-l do 
for iS from r[3]/2 to r[3]-l do 
for i4 from r[4]/2 to r[4]-l do 
for i5 from r[5]/2 to r[5]-l do 
tt:=0; 

for jl from r[l]-il-l to r[l]/2-l do 
for j2 from r[2]-i2-l to r[2]/2-l do 
for j3 from r[3]-i3-l to r[3]/2-l do 
for j4 from r[4]-i4-l to r[4]/2-l do 
for j5 from r[5]-i5-l to r[5]/2-l do 

ttt:=A[jl+l, j2+l, j3+l, j4+l,j5+l]*cc(r[l]-il-l,jl,r[l])*cc(r[2]-i2-l,j2,r[2]) ; 
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ttt:=ttt*cc(r [3]-i3-l, j3,r[3] )*cc(r [4]-i4-l, j4,r[4] )*cc(r [5]-i5-l, j5,r[5] ) ; 

tt:=tt+ttt; 

od; 

od; 

od; 

od; 

od; 

tt :=tt*f actorial(n[l] -il-l)*f actorial(n[2] -i2-l)*factorial(n[3] -13-1) ; 
tt : =tt*f actorial (n [4] -14-1) *f actorlal (n [5] -15-1) ; 
tt : =tt/ (factorial (n [1] -1) *f actorial (n [2] -1) ) ; 

tt : =tt/ (factorial (n [3] -1) *f actorial (n [4] -1) *f actorial (n [5] -1) ) ; 
ss : =ss+tt ; 

print(ll,i2,13,i4,15,ss) ; 

od; 

od; 

od; 

od; 

od; 

ss : =siniplif y(ss) ; 
returii(ss) ; 
end proc; 



#this procedure computes V_r for the T estimate in Section 4 
#It is assumed implicitly that k is 5 

#the procedure can be applied to any k (ndim) by changing the number 
#of do loops and making other appropriate changes 

#this procedure requires as input: n[l] ,n[2] , . . . ,n[k] ,r[l] ,r[2] , . . . ,r[k] , 

#ndim=the value of k and the output from coef f icients () 

Test := proc(ndim,n: :list,r: :list,A: : array) 

local il,i2,i3,i4,i5,jl,j2,j3,j4,j5,nn,tt, ttt , tttt , ss , a , kk ; 

ss:=0; 

for il from r[l]/2 to r[l]-l do 
for i2 from r[2]/2 to r[2]-l do 
for iS from r [3] /2 to r[3]-l do 
for i4 from r[4]/2 to r[4]-l do 
for i5 from r[5]/2 to r[5]-l do 
tt:=0; 

for jl from r[l]-il-l to r[l]/2-l do 
for j2 from r [2] -12-1 to r[2]/2-l do 
for j3 from r [3] -13-1 to r[3]/2-l do 
for j4 from r [4] -14-1 to r[4]/2-l do 
for j5 from r [5] -15-1 to r[5]/2-l do 

ttt:=A[jl+l, j2+l, j3+l, j4+l, j5+l]*cc(r[l]-ll-l,jl,r[l])*cc(r[2]-12-l,j2,r[2]) ; 

ttt : =ttt*cc (r [3] -13-1 , j 3 , r [3] ) *cc (r [4] -14-1 , j 4 , r [4] ) *cc (r [5] -15-1 , j 5 , r [5] ) ; 

tt:=tt+ttt; 

od; 

od; 
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od; 
od; 

od; 

nn[l] :=il; 
nn[2] :=i2; 
mi[3] :=i3; 
nn[4] :=i4; 
nn[5] :=i5; 
ttt:=l; 

for kk from 1 to ndim do 
tttt:=0; 

for a from nn[kk] to 100 do 

tttt :=tttt+(n[kk] )**(-a)*dalphai(a,nn[kk] ) ; 

od; 

ttt:=ttt*tttt; 

od; 

ss : =ss+tt*ttt ; 

print (il,i2,i3,i4,i5,ss) ; 

od; 

od; 

od; 

od; 

od; 

ss : =simplif y (ss) ; 
return (ss) ; 
end proc; 
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Table 5.1. Number of terms for estimates of bias 0{n for = 1. 



p = 


1 


2 


3 


-1 


5 


6 


7 


VnpiF) 


1 


2 


5 


11 


22 


42 


77 


Snp{F) 


1 


2 


4 


8 


15 


25 


44 


Tnp{F) 


1 


2 


5 


11 


21 







Table 5.2. Number of terms for estimates of bias O(nQ^), where no = min nj. 



p = 


1 


2 


3 


4 


5 




1 


A; + l 


S2 + 4fc + 1 


S3 + 8s2 + lOfc + 1 


S4 + 14s3 + 31s2 + 21fc + 1 


Snp(F) 






= (A;2 + 7fc + 2)/2 


= (fc3 + 21/c2 + 38fc + 6)/6 


= {k^ + 40fc3 + 305fc2 + 230A: + 24)/24 


1 


fc+ 1 


S2 + 3fc + 1 


S3 + 3S2 + 7fc + 1 


S4 + 9S3 + 15S2 + 14fc + 1 








= (/c2 + 5fc + 2)/2 


= (fc-"' + 6fc2 + 35fc + 6)/6 


= {k^ + 30k^ + 143fc2 + 234fc + 24)/24 


1 


fc + 1 


S2 + 4fc + 1 


S3 + 7S2 + lOfe + 1 


S4 + 13s3 + 25s2 + 20fc + 1 








= (A:2 + 7fc + 2)/2 


= (fc3 + 18/c2 + 20fc + 6)/6 


= {k* + 36k^ + 245k + 270fc + 24)/24 



Table 5.3. Number of terms for estimates of bias 0{n p) for A; = 2 and 3. 





k = 


2 










k = 


3 




p = 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


Vnp{F) 


1 


3 


10 


29 


74 


1 


4 


16 


56 


171 


Snp{F) 


1 


3 


8 


18 


44 


1 


4 


13 


32 


97 


Tnp{F) 


1 


3 


10 


28 


66 


1 


4 


16 


53 


149 
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Figure 6.1. The average absolute bias of the estimator of {q.\il\ + (1 — ai)/U2}^ when \i\ and H2 
are the means of two independent normal distributions with unit standard deviations. The average 
is based on 100 random samples each of size 100. 
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Figure 6.2. Mean squared error of the estimator of {ai^ui + (1 — ai)/U2}^ when ii\ and /i2 arc the 
means of two independent normal distributions with unit standard deviations. The MSB is based 
on 100 random samples each of size 100. 
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Figure 6.3. The average absolute bias of the estimator of when /^i and \X2 axe the means 

of two independent exponential distributions. The average is based on 100 random samples each 
of size 100. The x axis is in log scale. 
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Figure 6.4. Mean squared error of the estimator of 111/112 when /ii and /i2 arc the means of two 
independent exponential distributions. The MSE is based on 100 random samples each of size 100. 
The X axis is in log scale. 
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Figure 6.5. The average absolute bias of the estimator of a when a is the mean of an exponential 
distribution. The average is based on 100 random samples each of size 100. The x axis is in log 
scale. 




Figure 6.6. Mean squared error of the estimator of a when a is the mean of an exponential 
distribution. The average is based on 100 random samples each of size 100. The x axis is in log 
scale. 



36 




M./o 



Figure 6.7. The average absolute bias of the estimator of ///cr when fi and a are the mean and 
the standard deviation of a normal distribution. The average is based on 100 random samples each 
of size 100. The x axis is in log scale. 




Figure 6.8. The mean squared error of the estimator of ///cr when fi and a arc the mean and the 
standard deviation of a normal distribution. The MSE is based on 100 random samples each of 
size 100. The x axis is in log scale. 
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